software ring-fence

Terms from Artificial Intelligence: humans at the heart of algorithms

In robotics, or autonomous systems more generally a software ringfence acts to ensure that the ssytem does not operate outside safe parameters. Often there is a two-level architecture. At one level is a more intelligent planning algorithm, perhaps a neural network, that is able to vavigate or plan actions, but which could potentially faul to recognise dangers or otherwsie act in unacceptable ways. At a higher level is the software ring fence, which is often based on simple rules including spatial limits (like a physical fence) or other paramters. The higher-level system can veto potentially dangerous actions. For example, we might install an intelligent shower control that adjusts the heating element to maintain a desirable temperature; however this is accompanied by a cut-out that tmporarly shius off the power if the temperature exceeds a fixed maximum.

Used on page 364